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ABSTRACT 


This  report  describes  continuing  research  to  develop  automatic 
methods  for  measuring  cloud  motions  from  digital  brightness  data  obtained 
by  geosynchronous  satellites.  A  series  of  computer  programs  are  described 
that  register  successive  pictures  using  landmarks,  normalize  brightness 
for  changing  illumination,  locate  brightness  centers  (tracers)  for  groups 
of  cloud  elements,  match  brightness  centers  in  pairs  to  obtain  a  smooth 
field  of  motions,  and  transform  the  motions  from  tape  coordinates  to 
earth  coordinates.  The  methods  are  economical  computationally  since  co¬ 
ordinate  transformations  are  made  only  to  the  cloud  motion  vectors  ob¬ 
tained,  and  not  to  the  millions  of  brightness  elements  of  an  image.  Also, 
a  data  compression  is  accomplished  by  representing  groups  of  bright  points 
by  their  centers  plus  descriptors  of  the  group  shape.  In  cases  studied 
so  far,  good  results  have  been  obtained  for  single  cloud  layers  having  a 
fairly  uniform  motion.  Additional  work  is  required  to  cope  with  complex, 
multilayered  cloud  masses,  and  to  include  infrared  observations  antici¬ 
pated  from  future  satellites.  With  further  developments  that  are  en¬ 
visioned,  the  methods  are  expected  to  be  suitable  for  use  in  an  opera¬ 
tional  environment,  and  in  support  of  the  Global  Atmospheric  Research 
Program. 
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I  INTRODUCTION 


This  work  is  a  continuation  of  that  discussed  earlier  in  FAMOS 
TR  8-71  (Endlich,  Hall,  Wolf,  and  Brain,  1971),  and  published  recently 
in  a  summary  version  (Hall,  Endlich,  Wolf,  and  Brain,  1972).  The  ulti¬ 
mate  goal  of  the  research  is  to  develop  automatic  methods  for  measuring 
cloud  motions  from  digital  brightness  data,  without  human  intervention. 

The  objective  of  the  research  reported  herein  is  to  develop  specific 
computer  techniques  leading  to  this  goal.  The  determination  of  cloud 
motions  using  computers  is  also  under  investigation  by  Leese,  Novak, 
and  Clark  (1971)  and  by  Smith  and  Phillips  (1972).  In  the  procedure 
used  by  Leese,  Novak,  and  Clark,  a  cloud  pattern  for  a  sizeable  region 
is  tracked  en  masse  using  a  cross-correlation  technique.  The  detailed 
structure  of  the  cloud  pattern  and  variable  motions  within  it  are  ignored. 
The  procedure  of  Smith  and  Phillips  keeps  a  man  in  the  system  to  select 
tracer  clouds,  and  then  measures  their  motion,  also  by  cross-correlation. 
Our  system  selects  tracers  (brightness  centers)  automatically,  and 
matches  them  on  successive  pictures  to  obtain  a  smooth  but  variable 
field  of  displacements.  Comparisons  of  these  systems  by  applying  them 
to  a  common  set  of  data  are  needed. 

The  first  part  of  the  present  report  contains  further  tests  of  ob¬ 
jective  methods  (embodied  in  programs  DISK  and  MATCH)  for  registering 
landmarks  on  ATS-III  pictures.  A  major  portion  of  the  study  is  con¬ 
cerned  with  the  determination  of  cloud  motions  for  the  ”R  series”  of 
tapes  (for  24  June  1970)  by  using  the  ISODATA  and  MOTION  programs. 

These  programs  were  tested  and  improved  using  data  for  a  variety  of 
regions  chosen  to  encompass  different  cloud  types.  The  results  are 
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quite  satisfactory.  The  next  portion  of  the  report  describes  the  new 
computer  program  CORRECT,  which  maps  points  from  one  picture  onto  an¬ 
other  by  use  of  information  from  the  landmark  registration  program 
(MATCH).  It  makes  corrections  for  translation,  rotation,  X-stretching, 
and  Y-stretching.  It  also  contains  routines  to  transform  any  point 
from  tape  coordinates  (columns  X,  and  records  Y)  to  earth  coordinates 
(latitude  and  longitude),  or  the  reverse.  In  the  next  part  of  the  re¬ 
port,  an  initial  estimate  is  given  of  the  costs  of  cloud  motion  deter¬ 
mination  using  this  system.  Further  developments  needed  to  assemble  an 
objective,  operational  system  are  described  in  the  final  section. 
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II  MAJOR  ELEMENTS  OF  THE  AUTOMATIC  SYSTEM 


The  computer  programs  are  still  undergoing  testing,  and  considerable 
additions  and  changes  are  anticipated  to  make  them  operational.  The 
steps  in  the  process  as  presently  formulated  are  the  following: 

(1)  Register  picture  1  and  picture  2  in  (X,  Y)  coordinates 

(a)  Match  the  earth’s  disk  using  chords  (program  DISK) 

(b)  Match  landmarks  using  templates  (program  MATCH), 
giving  a  correction  for  translation  of  picture  2 
with  respect  to  picture  1 

(2)  Select  a  region  of  picture  1  and  the  same  region  of 
picture  2  allowing  for  translation  as  above  (program 
CLOUD) 

(3)  Perform  brightness  (Z)  normalization  (program  NORMALIZE) 

(a)  Compute  cumulative  brightness  frequencies  for  the 
region 

(b)  Normalize  the  second  picture  brightness  to  the 
first  one 

(4)  Locate  brightness  centers  (tracers) 

(a)  For  the  region,  set  brightness  thresholds  to  elimi¬ 
nate  background  (i.e.,  ground,  sea) 

(b)  Delete  isolated  (single)  points 

(c)  Apply  ISODATA  to  get  groups  and  their  centers 

•  Test  for  different  scales  and  sizes  of  groups 

•  Test  different  strategies  for  accuracy  and 
speed  of  computation 

(5)  Compute  cloud  motions  in  (X,  Y,  Z)  coordinates  (program 
MOTION) 
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(a)  Match  brightness  centers  from  picture  1  and  picture  2 
in  pairs,  to  get  a  smooth  field  of  motion  and  to  mini¬ 
mize  changes  in  the  brightness,  size,  and  shape  of 
paired  groups 

(b)  Delete  centers  without  mates  (i.e.,  matches 

(6)  Perform  final  registration  and  transformation  to  earth 

coordinates  (program  CORRECT) 

(a)  By  using  three  or  more  landmarks  in  (X,  Y)  coordi¬ 
nates,  correct  picture  2  to  picture  1  using  rotation, 
X-stretching,  and  Y-stretching 

(b)  Using  the  landmark  locations  on  an  ideal  picture, 
determine  coefficients  in  equations  that  map  any 
point  of  picture  1  onto  the  ideal  picture 

(c)  Convert  the  ideal  (X,  Y)  coordinates  of  cloud  motion 
vectors  to  speed  and  direction,  latitude  and  longitude. 

The  programs  DISK  and  MATCH  are  described  in  the  references  given 
earlier.  Since  then  only  minor  changes  have  been  made  to  them.  When 
the  satellite fs  orbit  and  attitude  are  relatively  stable,  the  earth's 
image  is  relatively  fixed  in  the  picture  frame  and  the  program  DISK  may 
not  be  needed.  The  program  CLOUD  selects  data  for  a  desired  region  to 
be  used  in  the  other  programs.  The  ATS-III  data  on  tape  has  8192  samples  o 
on  each  of  2400  lines.  Three  consecutive  samples  are  averaged  for  each 
column  so  that  an  approximately  square  element  is  obtained.  The  size  of 
the  region  is  usually  selected  to  be  50  lines  by  100  columns  or  100  lines 
by  200  columns.  For  the  smaller  area  the  brightness  data  on  a  256-level 
gray  scale  pertain  to  elemental  areas  approximately  2.5  miles  square  when 
looking  near  the  center  of  the  picture.  For  the  larger  area,  four  adja¬ 
cent  data  elements  are  averaged  to  reduce  later  computations  of  cloud 
motions,  giving  a  brightness  element  approximately  5  miles  square.  Use 
of  the  latter  averaged  data  in  cloud  tracking  appears  to  give  only  a 
negligible  loss  of  accuracy.  (In  landmark  matching  the  higher  resolution 
data  are  used.)  The  program  NORMALIZE  corrects  for  changes  in  illumina¬ 
tion  that  occur  in  a  region  as  the  solar  zenith  angle  varies  with  time 
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of  day.  The  ISODATA  program  and  some  initial  applications  were  described 
previously  (Ball  and  Hall,  1967;  Endlich,  Wolf,  Hall,  and  Brain,  1971). 

It  locates  centers  of  brightness  for  groups  of  points.  These  centers 
are  used  as  tracers  of  cloud  motions,  analogous  to  the  use  of  centers 
of  gravity  to  trace  motions  in  mechanical  systems.  ISODATA  also  reduces 
the  original  voluminous  data  to  a  much  smaller  set  that  contains  the  es¬ 
sential  information  concerning  tracer  elements.  The  MOTION  program  matches 
the  brightness  centers  of  two  consecutive  pictures  to  obtain  a  rather  uni¬ 
form  field  of  motion.  The  matching  of  brightness  centers  considers  the 
number  of  points,  average  brightness,  and  shape  of  groups,  and  checks  for 
consistency  of  these  factors.  Also,  it  allows  for  the  formation  of  new 
centers  or  the  disappearance  of  old  ones,  and  in  this  way  accounts  for 
the  complex  developmental  aspects  of  clouds.  The  program  CORRECT  uses 
landmark  information  to  register  two  successive  pictures.  Also,  by  using 
the  latitude  and  longitude  of  landmarks  and  the  concept  of  an  ideal  pic¬ 
ture,  it  transforms  the  cloud  locations  and  motions  to  earth  coordinates 
(latitude  and  longitude,  cloud  speed  and  direction).  The  latitude  and 
longitude  of  landmarks  are  identified  visually  by  comparing  digital  data 
printouts  (in  an  appropriate  form)  to  standard  maps.  This  simple  visual 
matching  is  the  only  act  in  this  series  of  operations  that  requires  human 
intervention.  At  present  it  must  be  performed  whenever  the  satellite  sub- 
point  is  changed  significantly. 

For  convenience  and  economy  during  development,  the  programs  are 
presently  broken  into  several  groups;  however,  the  final  system  that  is 
envisioned  will  operate  in  a  continuous  sequence. 
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Ill  LANDMARK  MATCHING 


In  FAMOS  TR  8-71,  experiments  were  described  that  used  ATS-III  tapes 
for  24  June  1970,  a  series  selected  for  us  by  Detachment  FAMOS.  This  we 
call  the  UR  series.”  It  was  found  that  DISK  matching  led  to  significant 
adjustments  (on  the  order  of  15  picture  elements)  between  pictures  25 
minutes  apart.  After  DISK  matching  was  performed,  only  minor  changes  of 
a  few  rows  or  columns  were  computed  by  the  MATCH  program  to  register 
selected  landmarks.  This  indicated  that  internal  differences  between 
these  particular  pictures  (in  X,  Y  coordinates)  were  quite  small.  If 
this  result  proves  to  be  generally  true,  many  facets  of  the  computer 
determination  of  cloud  motions  will  be  considerably  simplified. 

During  the  present  study  an  improvement  has  been  made  to  the  MATCH 
program  to  ensure  that  it  makes  an  exhaustive  search  in  the  area  of 
best  fit  of  a  landmark  template,  and  reaches  the  point  of  best  agreement. 
Also,  experiments  were  carried  out  using  brightness  gradients  in  match¬ 
ing  in  place  of  the  original  digital  brightness.  The  gradient  at  a 
point  is  computed  as  the  sum  of  the  absolute  value  of  a  northeast- 
southwest  brightness  difference  and  an  absolute  value  of  northwest- 
southeast  difference.  The  gradients  tend  to  be  relatively  large  along 
coastlines,  and  therefore,  we  thought  that  they  might  aid  in  landmark 
matching.  However,  in  actual  tests  no  mathematical  advantage  was  found 
using  gradients  instead  of  the  original  digital  brightness  values.  On 
the  other  hand,  special  printouts  of  the  gradients  were  found  to  aid  in 
visually  checking  the  results  of  computer  matches,  and  the  gradients 
have  been  retained  for  this  purpose. 
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A  second  series  of  tapes  denoted  "s"  (for  23  August  1969)  has  been 
treated  to  a  limited  extent  in  the  present  study.  For  these,  both  DISK 
and  MATCH  adjustments  are  quite  small,  evidently  because  the  satellite’s 
attitude  and  orbit  were  nearly  ideal.  Some  typical  matches  are  illus¬ 
trated  below. 

Figure  1  shows  the  ATS-III  picture  for  1620  GMT  on  23  August  1969. 
This  is  the  fifth  picture  of  the  daily  sequence  and  is  designated  S-5. 

The  picture  was  produced  from  tape  on  a  facsimile  recorder,  with  every 
100th  line  and  300th  column  identified  as  an  aid  in  visually  checking 
computer  results  described  later.  Figure  2  shows  a  printout  of  gradients 
of  digital  brightness  for  a  portion  of  the  coast  of  northwest  Africa. 

The  coastline  runs  from  upper  right  to  lower  left  in  each  half  of  Figure 
2.  The  left-hand  part  of  the  figure  is  for  S-5,  and  the  right-hand  por¬ 
tion  is  for  the  next  picture  S-6  at  1645  GMT.  The  pictures  have  been 
adjusted  to  a  first  approximation  for  translation  as  indicated  by  the 
program  DISK.  In  this  case  the  DISK  adjustment  was  only  one  row  and  one 
column.  Small  magnitudes  of  gradients  (mainly  over  the  ocean)  are  not 
printed  in  the  figure.  Large  gradients  exist  at  the  coast  and  also  along 
the  edges  of  clouds.  Where  a  brightness  value  exceeds  a  certain  threshold 
(here  chosen  as  55)  the  gradient  is  not  computed  and  a  star  is  printed. 
This  computer  printout  has  the  important  role  of  facilitating  visual  in¬ 
spection  of  computer  landmark  matching  during  the  research  process.  The 
brightness  values  in  the  second  picture  (S6)  were  normalized  to  the  levels 
in  the  first  picture  (S5)  using  the  method  described  in  Chapter  IV. 

The  location  of  a  landmark  template  (20  by  20  brightness  values) 
is  enclosed  by  lines  in  Figure  2.  The  brightness  values  for  this  tem¬ 
plate  are  shown  in  Figure  3.  From  Figure  2,  one  can  see  that  the  coast 
in  S-5  is  displaced  downward  and  slightly  to  the  left  on  tape  S-6.  The 
computer  program  MATCH  makes  the  same  decision  (one  row  down  and  one 
column  to  the  left),  as  indicated  in  Figure  4.  This  figure  shows  the 
"distances"  (RMS  differences  in  brightness)  between  the  template  (from 
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FIGURE  1  THE  ATS-III  CLOUD  PICTURE  AT  1620  GMT  ON  23  AUGUST  1969 
(DESIGNATED  AS  TAPE  S-5).  Horizontal  lines  are  at  increments  of 
167  records.  Vertical  lines  are  at  increments  of  400  brightness  elements 
within  records. 
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FIGURE  2  COMPUTER  PRINTOUT  OF  BRIGHTNESS  GRADIENTS  FOR  A  PORTION  OF 
AFRICA  FOR  TAPES  S-5  (LEFT)  AND  S-6  (RIGHT).  The  coast  runs  from 
upper  right  to  lower  left.  The  location  of  a  landmark  template  on  S-5  is 
enclosed  by  lines. 


AFkICA-2  Sa-Sb  Sb  ADJUSlEo  IU  V. 
KEYX*  2)  *\EYf*  2 u 


MA  X  A  T  a  20 


MAX Y  T  *  20*  NH1C*  2 


TEMPLATE: 


33 

in 

29 

31 

3o 

Jl 

2* 

30 

2b 

32 

2d 

2b 

28 

27 

25 

27 

26 

30 

29 

24 

2* 

31 

3>l 

3  1 

31 

Ja 

2»t 

24 

26 

27 

33 

27 

26 

23 

25 

28 

26 

30 

23 

29 

25 

2  i 

27 

25 

3) 

23 

2M 

25 

26 

29 

24 

26 

25 

25 

26 

25 

22 

21 

23 

27 

2* 

27 

29 

10 

22 

2r» 

24 

27 

?6 

22 

27 

27 

30 

27 

24 

24 

30 

29 

27 

25 

27 

21 

JO 

2** 

2b 

12 

24 

33 

22 

20 

24 

27 

24 

30 

25 

26 

25 

27 

28 

27 

?H 

25 

2* 

2* 

25 

2  3 

32 

22 

?b 

2o 

23 

24 

27 

10 

25 

28 

28 

24 

30 

37 

?6 

29 

2b 

28 

33 

2  b 

29 

2  b 

30 

2b 

28 

33 

35 

39 

43 

50 

51 

52 

48 

56 

2* 

2b 

2a 

23 

2^ 

23 

2b 

!«> 

4b 

53 

5b 

58 

59 

58 

55 

59 

57 

55 

58 

53 

?6 

2* 

2b 

2  b 

2s 

21 

23 

33 

43 

*  a 

55 

55 

54 

57 

63 

55 

50 

55 

bl 

56 

2n 

27 

2b 

2  V 

27 

23 

2b 

27 

45 

42 

35 

55 

56 

47 

5j 

58 

51 

53 

50 

56 

26 

2* 

29 

2b 

2  b 

2  0 

2*1 

37 

•*b 

53 

34 

42 

45 

47 

52 

53 

49 

57 

48 

55 

?  7 

2* 

2o 

2b 

24 

2  9 

4<i 

43 

54 

56 

30 

53 

54 

52 

58 

53 

58 

55 

52 

32 

11 

32 

27 

2b 

4  1 

32 

5b 

49 

64 

53 

58 

43 

52 

53 

50 

49 

52 

51 

2s? 

27 

27 

29 

1i 

27 

*♦7 

52 

50 

5o 

56 

39 

61 

60 

55 

50 

51 

58 

53 

51 

27 

26 

25 

23 

3 1 

24 

lb 

47 

40 

57 

63 

62 

63 

62 

57 

58 

56 

57 

61 

ul 

2* 

2H 

31 

29 

32 

2b 

48 

40 

4tt 

b  1 

59 

57 

69 

55 

54 

S3 

52 

56 

52 

29 

29 

25 

29 

30 

2  b 

14 

56 

47 

59 

b2 

63 

63 

56 

61 

52 

54 

54 

55 

55 

25 

27 

2H 

27 

28 

3  j 

17 

SJ 

4  9 

53 

*»J 

b  3 

61 

58 

60 

54 

51 

53 

6b 

54 

27 

27 

27 

2b 

?8 

2' 

17 

48 

40 

53 

50 

53 

55 

55 

59 

48 

58 

53 

55 

52 

27 

25 

2b 

2  3 

3? 

2  1 

•*0 

4  8 

4  8 

51 

33 

53 

53 

54 

54 

50 

so 

47 

55 

5o 

FIGURE  3  THE  DIGITAL  BRIGHTNESS  VALUES  OF  TAPE  S-5  FOR  THE  LANDMARK 
TEMPLATE  INDICATED  IN  FIGURE  2 


the  first  tape)  and  the  brightness  values  of  the  second  tape  at  different 
positions.  The  best  match  (least  distance)  is  4.68,  which  is  consider¬ 
ably  better  than  at  the  surrounding  points.  Therefore  we  have  confidence 
in  this  result.  (The  number  80,58  is  inserted  at  points  for  which  no 
calculation  was  made.) 

It  is  also  worth  noting  that  the  upper  left-hand  part  of  the  land¬ 
mark  rectangle  in  Figure  2  contains  a  cloud  edge.  We  have  not  found  a 
way  to  completely  eliminate  interference  from  clouds  in  the  matching 
process.  As  described  in  FAMOS  TR  8-71,  for  most  landmarks  their  in¬ 
fluence  is  minimized  by  ignoring  points  brighter  than  a  given  level 
(such  as  55)  typical  of  clouds.  This  strategy  appears  to  be  generally 
satisfactory. 

We  next  show  a  landmark  for  a  portion  of  the  northern  part  of  Lake 
Titicaca  in  Bolivia,  easily  discernible  in  Figure  1.  The  gradients  for 
tapes  S-5  and  S-6  are  shown  in  Figure  5.  An  approximate  outline  of  the 
lake  has  been  sketched  to  facilitate  inspection.  The  landmark  template 
on  picture  S-5  is  enclosed  by  lines  and  the  digital  brightness  is  given 
in  Figure  6.  From  Figure  5,  the  eye  can  detect  a  relative  displacement 
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landmark  template  are  indicated. 
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FIGURE  6  THE  DIGITAL  BRIGHTNESS  VALUES  OF  TAPE  S-5  FOR  THE  LANDMARK 
OF  FIGURE  5. 


of  the  outline  of  the  lake  from  S-5  to  S-6,  similar  to  that  shown  earlier 
for  the  African  landmark.  The  computer  match  finds  a  minimum  distance 
of  4, 02,  displaced  2  rows  down  and  1  column  to  the  left  of  the  original 
template  position,  as  shown  in  Figure  7.  Exactly  the  same  displacement 
was  computed  using  a  second  template  that  included  the  southern  end  of 
Lake  Titicaca. 
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FIGURE  7  A  MAP  OF  RMS  BRIGHTNESS  DIFFERENCES  BETWEEN  THE  LANDMARK 
TEMPLATE  (FIGURE  6)  AND  TAPE  S-6.  The  template  (referenced  at  20,20 
on  S-5)  fits  best  at  19,22  on  S-6. 
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One  of  the  best  landmarks  in  this  part  of  the  world  is  a  large, 
bright,  dry  lake  in  Bolivia  called  Salar  de  Uyuni .  The  landmark  template 
for  a  portion  of  this  lake  is  shown  in  Figure  8,  Some  brightness  values 
are  as  high  as  those  found  with  bright  clouds,  so  that  a  brightness 
cutoff  (e.g.,  55)  is  not  used  for  this  landmark.  Very  large  brightness 
gradients  exist  in  the  template,  much  larger  than  those  in  Figure  3  and  6. 
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FIGURE  8  THE  DIGITAL  BRIGHTNESS  VALUES  OF  TAPE  S-5  FOR  A  LANDMARK  AT 
THE  SOUTHWEST  CORNER  OF  THE  SALAR  DE  UYUNI 


For  this  landmark  the  computer  matching  (Figure  9)  gives  a  very  clearly 
marked  minimum  displaced  2  rows  down  and  2  columns  to  the  left  of  the 
original  template  position.  The  values  of  distance  in  Figure  8  have  such 
a  clear  pattern  that  one  could  interpolate  a  fit  to  a  location  between 
the  positions  for  which  computations  were  made. 

For  the  same  pair  of  tapes,  other  landmarks  were  selected  and 
matched  with  very  similar  results.  One  of  these  was  along  the  north¬ 
east  coast  of  Brazil.  Here  the  brightness  contrasts  are  relatively 
small,  and  cloud  contamination  is  frequent,  so  the  landmark  is  not  highly 
reliable.  Landmarks  along  the  cost  of  Chile  have  fairly  good  brightness 
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FIGURE  9  A  MAP  OF  RMS  BRIGHTNESS  DIFFERENCES  BETWEEN  THE  LANDMARK 
TEMPLATE  (FIGURE  8)  AND  TAPE  S-6.  The  template  (referenced  at  20,20 
on  S-5)  fits  best  at  18,22  on  S-6. 


constrasts,  but  are  expected  to  be  cloud  covered  on  many  occasions.  In 
the  present  case,  a  Chilean  landmark  (at  29°S)  was  displaced  two  rows 


down  and  two  columns  to  the  left  on  picture  S-6  compared  to  S-5,  and  an 
Argentine  coastal  landmark  (at  35°S)  was  displaced  three  rows  down  and 


one  column  to  the  left. 


Experiments  of  this  sort  show  that  automatic  landmark  matching  can 


be  done  for  a  variety  of  landmarks.  For  some  of  them  (e.g.,  Figure  7) 


the  pattern  of  fit  is  rather  flat  in  the  vicinity  of  the  best  match,  so 


that  fitting  to  one  picture  eLement  is  near  the  limit  of  accuracy  that 


can  be  achieved.  On  the  other  hand,  for  a  very  sharply  defined  landmark 
(such  as  that  of  Figure  8),  interpolati ve  matching  finer  than  a  picture 
element  appears  feasible.  It  is  also  important  to  note  that  the  landmark 


displacements  in  different  parts  of  the  picture  are  nearly  the  same, 


indicating  that  internal  distortions  are  small  for  this  sequence  of  tapes. 
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IV  BRIGHTNESS  NORMALIZATION 


At  a  given  place  the  sun's  illumination  is,  of  course,  a  maximum 
at  local  noon.  During  the  middle  of  the  day  changes  in  illumination 
from  picture  to  picture  are  relatively  slight,  but  they  are  quite  signifi¬ 
cant  in  the  early  morning  or  late  afternoon.  The  simplest  assumption 
that  one  can  make  about  brightness  is  that  it  will  vary  directly  with 
the  secant  of  the  solar  zenith  angle.  Some  of  the  brightness  data  we 
have  examined  indicate  that  the  relationships  are  actually  more  complex. 
Therefore  an  empirical  correction  is  made  by  the  program  NORMALIZE.  It 
is  assumed  that  the  cloud  population  in  a  region  several  hundred  miles 
on  a  side  remains  unchanged  from  one  picture  to  the  next,  even  though 
random  variations  may  occur  in  individual  cloud  elements.  With  this 
assumption,  histograms  of  brightness  at  the  two  times  would  be  the  same 
except  for  changes  in  illumination.  Cumulative  histograms  are  computed 
for  picture  1  and  picture  2.  For  example,  for  a  250  by  500  mile  portion 
of  a  frontal  band  in  the  mid-Atlantic,  picture  2  has  303  points  (out  of 
5000)  having  brightness  ^  70,  while  in  picture  1,  there  are  330  such 
elements.  We  wish  to  find  the  brightness  level  on  picture  1  which  has 
303  elements  of  equal  or  greater  brightness,  and  find  from  the  histogram 
that  the  level  72  on  picture  1  meets  this  criterion.  Therefore  the 
level  70  on  picture  2  corresponds  to  the  level  72  on  picture  1.  Similar 
computations  made  by  the  subroutine  NORMALIZE  give  the  corresponding 
brightness  levels  shown  in  Figure  10,  The  dashed  line  would  imply  per¬ 
fect  agreement.  Deviations  from  perfect  agreement  are,  of  course, 
greatest  for  picture  pairs  in  early  morning  or  late  afternoon.  In  such 
cases  the  normalization  is  important,  particularly  if  landmark  matching 
is  to  be  done  in  the  region.  For  picture  pairs  near  local  noon  (as  in 
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Figure  10),  brightness  normalization  is  probably  not  needed.  In  the 
present  system,  brightness  normalization  is  done  routinely  prior  to  use 
of  the  ISODATA  program;  however,  a  criterion  to  use  it  selectively  will 
be  introduced  in  further  work. 


BRIGHTNESS  FOR  PICTURE  ONE 

FIGURE  10  GRAPH  OF  EQUIVALENT  BRIGHTNESS  VALUES  ON  TAPE  S-5  (PICTURE  1) 
AND  TAPE  S-6  (PICTURE  2)  FOR  A  250  BY  500  MILE  PORTION  OF  A 
FRONTAL  BAND 
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V  APPLICATION  OF  THE  ISODATA  AND  MOTION  PROGRAMS 


The  ISODATA  program  (Ball  and  Hall,  1967)  performs  two  basic  func¬ 
tions.  Firstly,  it  gives  a  major  compaction  in  the  amount  of  data  needed 
for  the  present  purpose,  and  secondly,  it  selects  brightness  centers  for 
use  as  tracers  (Endlich,  Hall,  Wolf,  and  Brain,  1971),  The  centers  are 
analogous  to  the  cloud  centroids  identified  by  eye  by  Shenk  and  Kriens 
(1970) .  ISODATA  subdivides  a  data  set  into  "natural"  groups,  and  then 
computes  the  group  center  and  group  shape  parameters  (standard  deviations 
in  X  and  Y  direction,  skewness,  and  kurtosis  of  brightness).  These  few 
statistics  describe  the  groups  quite  adequately.  Input  parameters  to 
ISODATA  exert  control  over  the  approximate  number  of  centers  desired, 
the  typical  distance  between  them,  or  the  rms  distance  of  points  from 
their  centers.  The  centers  found  on  one  picture  are  used  as  initial 
guesses  in  applying  ISODATA  to  the  second  picture.  In  this  case  ISODATA 
shifts  the  brightness  centers  to  their  new  positions  of  best  fit.  The 
difference  between  the  coordinates  of  the  brightness  centers  in  the  two 
pictures  is  a  measure  of  the  displacement  of  the  centers.  These  dis¬ 
placements  may  be  transformed  into  earth  distances  and  divided  by  the 
time  interval  between  pictures  to  give  the  motion  vectors  of  the  bright¬ 
ness  centers  representing  the  clouds.  With  this  approach,  the  motions 
of  centers  will  be  representative  of  the  average  motion  of  the  cloud 
elements  that  belong  to  the  group. 

In  the  present  study,  the  following  strategy  for  using  ISODATA  was 
formulated  empirically.  Two  control  parameters  are  furnished  as  input. 
One  of  these  is  a  search  radius  that  tends  to  control  the  initial  size 
of  groups.  A  relatively  large  search  radius  gives  a  small  number  of 
large  groups,  and  conversely.  The  second  control  parameter  is  called 
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0  ,  the  splitting  parameter.  During  each  iteration,  ISODATA  selects 
c 

the  most  elongated  group  and  makes  a  trial  splitting  of  it  into  two 
subgroups.  If  the  new  subgroup  centers  are  more  than  the  distance  0 

c 

apart  the  splitting  is  retained;  otherwise  the  original  group  is  saved. 

Thus  the  search  and  splitting  operations  of  ISODATA  are  used  to  define 

groups,  without  use  of  other  options  in  the  ISODATA  program.  Usually 

three  to  six  iterations  give  stable  results.  In  many  of  the  present 

runs,  satisfactory  results  have  been  obtained  by  setting  the  search 

radius  equal  to  20  units  of  X  (or  Y),  and  0  equal  to  10.  The  resulting 

c 

cloud  motions  are  not  affected  significantly  by  varying  these  parameters 
by  a  factor  of  2. 

In  using  ISODATA,  the  computations  increase  with  the  number  of 
points,  and  therefore  it  is  desirable  to  keep  the  number  of  points  fairly 
low.  A  number  of  approximately  300  gives  a  rapid  computation.  If  there 
are  extensive  clouds  in  the  region  being  treated,  300  brightness  values 
are  inadequate  to  describe  the  total  pattern.  In  this  case  it  may  be 
desirable  to  subdivide  (or  slice)  the  data,  first  taking  the  brightest 
300  points,  then  the  next  brightest  300,  etc. ,  until  background  values 
are  encountered.  This  is  only  an  interim  procedure,  while  more  power¬ 
ful  alternatives  are  being  formulated. 

Another  step  in  treating  the  data  for  use  by  ISODATA  is  the  dele¬ 
tion  of  isolated  points  from  the  data  arrays,  i.e.,  a  point  bright  enough 
to  be  considered  as  cloud,  but  having  no  adjacent  neighbors,  is  deleted. 
This  tends  to  remove  small,  changeable  features  that  would  often  be  noise 
in  the  groupings  made  by  ISODATA. 

The  use  of  the  brightness  centers  found  on  the  first  picture  of  a 
pair  as  first-guess  centers  on  the  second  picture  speeds  up  the  ISODATA 
computation  on  the  second  picture,  and  also  tends  to  ensure  continuity 
of  the  centers. 


20 


As  mentioned  earlier,  centers  of  brightness  determined  by  ISODATA 
in  two  photographs  separated  in  time  by  an  appropriate  amount  must  be 
matched  so  that  the  displacement  of  a  center  can  be  computed  from  its 
change  in  coordinates.  In  doing  this,  one  encounters  a  practical  dif¬ 
ficulty  because  a  cloud  group  and  its  brightness  center  may  appear  on 
one  picture  of  a  pair,  but  not  the  other.  This  can  occur  because  of 
formation  or  dissipation  of  a  cloud  group,  or  movement  of  a  group  across 
a  boundary  of  the  digitized  area.  For  this  reason,  there  may  not  be 
mates  for  all  the  brightness  centers,  and  pair  matching  may  be  confused. 
The  MOTION  program  copes  with  this  problem  under  most  circumstances. 

It  matches  those  pairs  that  are  "good”  mates  and  discards  those  centers 
that  do  not  have  a  mate. 

At  present  the  matching  of  brightness  centers  by  the  MOTION  program 
is  based  on  the  following  factors:  the  expected  motion  vector  for  the 
region  (if  known),  the  number  of  points  in  groups,  the  average  bright¬ 
ness  of  groups,  and  the  shape  of  groups.  If  there  is  no  previous  know¬ 
ledge,  the  initial  matching  looks  for  a  motion  of  zero,  which  is  equiva¬ 
lent  to  looking  for  nearest  neighbors  in  matching  centers  at  times  1 
and  2.  In  addition,  the  matching  associates  groups  having  the  same 
size,  brightness,  and  shape.  In  practice,  weights  must  be  assigned  to 
the  various  factors  to  specify  their  relative  importance.  So  far  this 
assignment  has  been  done  on  a  purely  empirical  basis,  in  a  manner  that 
gives  acceptable  results  for  a  variety  of  cases. 

After  the  initial  matching,  the  motion  components  AX  and  AY  for 
each  matched  pair  of  brightness  centers  are  computed,  and  the  average 
AX  and  AY  for  the  region  are  found.  The  matching  process  is  then  re¬ 
peated,  with  these  averages  used  to  define  the  expected  positions  of 
pairs.  Generally,  the  pair  matching  will  be  changed  from  that  of  the 
initial  iteration,  so  that  a  somewhat  different  field  of  motion  is  ob¬ 
tained.  This  f ield-of-motion  vectors  tends  to  be  in  agreement  with  the 
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average,  and  this  introduces  uniformity  over  the  region.  The  process  is 
repeated  until  the  results  become  stable.  Usually  this  requires  no  more 
than  four  iterations. 

These  concepts,  which  are  difficult  to  grasp  in  abstract  discussion, 
are  now  illustrated  with  several  examples  based  on  the  R-series  of  tapes. 

A.  Cloud  Mass  off  the  Brazilian  Coast 

The  digital  brightness  data  for  this  area  for  tape  R-l  (correspond- 

* 

ing  to  1602  GMT)  are  shown  in  Figure  11(a).  Each  digit  represents  the 
average  brightness  in  a  5  by  5  mile  element  (approximately),  computed 
by  averaging  the  original  values  of  four  2.5  by  2.5  mile  elements.  The 
50  by  100  array  therefore  covers  a  region  of  approximately  250  by  500 
miles.  For  this  presentation,  the  digits  are  scaled  so  that  a  1  repre¬ 
sents  brightness  in  the  range  10  to  19,  2  represents  20-29,  and  so  on, 
then  using  the  alphabet  for  brightness  >  100.  The  ocean  background  con¬ 
sists  mainly  of  l’s.  To  see  exactly  the  same  data  in  a  more  familiar 
pictorial  form,  a  display  on  the  computer  controlled  cathoderay- tube 
(CRT)  display  was  made  using  10  levels  of  shading  as  shown  in  Figure  11(b). 
The  divisions  between  shades  may  be  set  arbitrarily.  We  have  set  them 
in  a  simple  manner;  however,  by  judicious  choice,  one  could  use  this 
selectivity  to  enhance  certain  cloud  features  for  inspection. 

The  brightness  data  for  the  same  region  of  tape  R-2  (at  1628  GMT) 
corrected  for  translation  are  shown  in  Figure  12(a),  and  the  CRT  picture 
is  also  illustrated.  The  patterns  are  of  course  very  similar  to  those 
of  Figure  11  in  broad  features. 


* 

Figures  are  shown  at  the  end  of  this  section,  p.  27. 
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As  mentioned  earlier,  it  has  been  convenient  so  far  for  ISODATA  to 
operate  on  approximately  300  data  points.  Therefore  the  data  are  scan¬ 
ned  beginning  with  the  brightest,  and  points  are  saved  for  successively 
smaller  brightness  values  until  the  number  of  points  exceeds  300.  The 
resulting  subset  from  Figure  11  is  shown  in  Figure  13.  A  similar  sub¬ 
set  from  Figure  12  (26  minutes  later)  is  shown  in  Figure  14. 

Part  of  the  printout  of  information  about  the  16  groups  selected 
by  ISODATA  is  shown  in  Figure  15.  For  example,  the  first  group,  con¬ 
sisting  of  33  points  (or  patterns),  is  centered  at  X  =  239.82,  Y  =  45.45, 
and  has  an  average  brightness  of  98.61.  Similarly,  Figure  16  is  a  print¬ 
out  for  the  second  picture,  which  is  divided  into  17  groups.  The  infor¬ 
mation  is  shown  graphically  for  the  two  times  in  Figures  17  and  18  with 
dots  marking  data  points  and  Cfs  marking  X  and  Y  locations  of  group 
centers.  (The  Cfs  frequently  overlie  data  points.)  Points  belong  to 
the  nearest  group  center.  The  ISODATA  computations  were  made  with  the 
search  radius  (sphere  factor)  equal  to  20,  and  the  splitting  distance 

0  equal  to  10.  Here  one  can  see  how  ISODATA  distributes  centers  in  a 
c 

typical  amorphous  cloud  pattern.  As  mentioned  earlier,  the  brightness 
centers  of  the  first  picture  (Figure  17)  are  used  as  a  first  guess  in 
operating  on  the  second  one  (Figure  18) .  In  this  case,  the  leftmost 
group  in  Figure  17  is  changed  somewhat  in  Figure  18,  and  is  divided  into 
two  groups,  giving  an  additional  center.  However,  all  of  the  other  15 
centers  in  Figure  17  have  counterparts  in  Figure  18.  It  should  also  be 
realized  that  if  different  values  of  the  search  radius  and  splitting 
distance  had  been  used,  a  different  set  of  centers  would  have  been  ob¬ 
tained.  By  choosing  smaller  values  for  them,  one  would  obtain  more 
centers,  and  therefore  more  motion  vectors.  The  setting  of  these  con¬ 
trols  is  made  empirically  to  meet  the  intended  analysis  resolution. 

To  illustrate  the  problem  of  matching  centers,  refer  to  Figure  19. 
Here  the  l’s  are  the  first  centers  (from  Figure  20),  and  the  2!s  are  the 
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second  set  (from  Figure  18),  while  3’s  denote  1 1 s  and  2Ts  superposed 
because  of  the  inability  of  the  line  printer  to  resolve  them  when  they 
are  close  together.  As  mentioned  earlier,  the  matching  process  looks  for 
an  expected  vector  difference  (which  may  be  set  to  zero  initially),  and 
also  pairs  groups  having  similar  characteristics.  A  key  computation  in 
the  computer  matching  involves  the  "fitting  factor,"  which  compares  each 
center  of  picture  1  to  each  center  of  picture  2.  For  the  present  case, 
this  matrix  is  shown  in  the  upper  part  of  Figure  20.  The  best  fit,  the 
value  4.6  enclosed  by  a  rectangle,  is  between  center  3  on  picture  1  and 
center  3  on  picture  2.  The  lower  part  of  Figure  20  shows  the  matched 
pairs  in  order,  designated  by  letters  of  the  alphabet.  The  first  pair 
(A)  implies  a  cloud  motion  having  components  in  the  X  and  Y  directions 
of  -3.7  and  0.1  units.  (The  conversion  of  these  units  to  earth  coordi¬ 
nates  is  discussed  in  Section  VI.  For  this  particular  area,  the  com¬ 
ponents  should  be  multiplied  by  6,  approximately,  to  obtain  cloud  motions 
in  knots.)  The  midpoint  of  the  motion  vector  A  is  at  X  =  281.0  and 
Y  =  25.1,  and  the  average  brightness  of  the  two  centers  is  88.2.  Other 
information  is  also  given  for  purposes  of  monitoring  the  decisions  made 
by  the  program. 

The  12  matched  pairs  are  shown  graphically  in  Figure  21  along  with 
their  identifying  letters.  The  motions  go  from  l’s  to  2fs,  whereas  3!s 
imply  motions  of  approximately  zero.  Centers  which  do  not  have  an  accom¬ 
panying  letter  are  not  matched,  even  though  a  line  connecting  them  may 
appear  reasonable  to  the  eye.  This  is  because  rejection  can  occur  due 
to  changes  in  size  of  a  group  (marked  growth  or  decay),  complications 
due  to  movements  across  the  edges  of  a  region,  changes  in  shape  or  bright¬ 
ness,  or  motion  quite  different  from  the  average  motion  of  the  other 
matched  pairs.  In  practice,  rejection  is  made  by  rating  each  vector, 
and  comparing  the  rating  to  a  critical  value.  In  Figure  20  this  critical 
value  is  set  at  10,  and  pairs  having  larger  values  (poorer  matches)  are 
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rejected.  These  ratings  are  given  in  the  column  marked  FIT.  In  general, 
we  believe  it  is  desirable  to  eliminate  most  of  the  doubtful  matches, 
so  that  those  retained  are  meteorologically  acceptable.  One  method  of 
determining  meteorological  acceptability  will  be  to  examine  the  same 
cases  visually  using  the  SRI  electronic  cloud  console.  This  task  re¬ 
mains  to  be  done. 

B.  Clouds  off  the  African  Coast 

Visual  material  analogous  to  that  shown  in  Section  A  above  is  avail¬ 
able  for  the  present  region;  however,  to  conserve  the  reader's  time, 
only  a  few  selected  illustrations  will  be  used.  Figures  22  and  23  show 
CRT  plots  of  the  digital  data  for  the  area.  For  tape  R-l  the  300  bright¬ 
est  points  and  the  centers  found  by  ISODATA  are  shown  in  Figure  24, 

Using  these  centers  as  the  initial  guess  on  tape  R-2,  the  group  centers 
of  Figure  25  are  computed.  Both  sets  of  brightness  centers,  and  the 
15  matching  pairs,  are  shown  in  Figure  26.  In  our  opinion,  they  have 
sufficient  uniformity  to  be  meteorologically  reasonable.  The  average 
displacement  components  for  the  region,  printed  in  the  lower  left  corner, 
are  computed  without  using  the  motions  near  the  edge,  which  may  be  un¬ 
reliable,  as  discussed  earlier. 

C.  A  Portion  of  the  I nter tropical  Convergence  Zone 

The  examples  shown  above  indicate  that  reasonable  looking  vectors 
are  obtained  for  some  typical  cloud  systems  having  motions  that  are 
relatively  uniform.  However,  many  of  the  most  significant  atmospheric 
phenomena  contain  a  variety  of  clouds  whose  motions  vary  both  in  the 
vertical  and  horizontal.  One  such  phenomenon  is  the  ITCZ.  We  have 
made  some  preliminary  experiments  with  ITCZ  data,  but  considerable  addi¬ 
tional  logic  will  be  needed  to  treat  it  adequately. 
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A  printout  of  digital  brightness  data  and  a  CRT  picture  for  tape 
R-l  are  shown  in  Figure  27,  and  Figure  28  shows  similar  information  for 
tape  R-2.  The  divisions  between  grey  levels  have  been  set  differently 
than  in  previous  CRT  pictures,  to  give  greater  emphasis  to  the  brightest 
elements.  The  brightness  values  cover  a  wide  range,  from  approximately 
200  (denoted  by  the  letter  J  in  the  digital  printout),  down  to  the  ocean 
background  (lfs  and  2fs).  Brightness  centers  found  by  ISODATA  for  the 
300  brightest  points  are  portrayed  in  Figures  29  and  30.  The  matched 
pairs  of  Figure  31  indicate  a  rather  uniform  westward  motion,  which 
seems  reasonable.  To  track  other  elements  of  intermediate  brightness, 

300  points  (having  a  brightness  range  of  61  to  75)  were  selected  on  the 
two  tapes.  These  points  and  the  brightness  centers  found  by  ISODATA 
are  shown  in  Figures  32  and  33.  By  reference  to  Figures  27  and  28,  it 
can  be  seen  that  most  of  these  points  lie  along  the  edge  of  the  brightest 
region.  The  matched  pairs  of  centers  are  shown  in  Figure  34.  The  results 
are  quite  erratic,  and  therefore  suspicious.  Other  similar  cases  using 
a  range  of  intermediate  brightness  also  gave  erratic  cloud  motions. 

This  indicates  tentatively  that  the  "slicing”  of  brightness  for  cases 
of  this  type  only  gives  satisfactory  results  for  the  brightest  elements, 
whereas  the  points  of  intermediate  brightness  mainly  represent  cloud 
edges  which  should  not  be  tracked.  Further  study  of  such  cases  is  re¬ 
quired.  Some  possible  methods  for  dealing  with  them  are  discussed  in 
Section  VIII.  Looking  toward  the  SMS  satellites,  it  is  probable  that 
the  availability  of  IR  data  will  aid  in  interpreting  such  cases. 


26 


T APE  R»1 


^CSTtPN  A7LAN71C  OCEAN  OFF  THE  BPAZILUN  COAJT. 

L INC? 11801579  COLS  5751  6950 


LINE 

2 

LINE 

* 

LINC 

6 

LINC 

8 

LINF 

10 

L  INF 

12 

LINC 

1* 

LINC 

1* 

LINf 

18 

LINC 

20 

LINC 

22 

LINC 

2* 

LINC 

26 

LINC 

2« 

LINC 

30 

LINF 

32 

LINC 

3* 

LINC 

36 

LINC 

3« 

LINC 

40 

LINC 

*2 

LINC 

4* 

LINC 

46 

LINC 

48 

LIN* 

50 

LINC 

52 

LINC 

5* 

LINC 

56 

LINC 

58 

LINC 

60 

LINF 

62 

LINC 

64 

LINC 

66 

LlNC 

68 

LINC 

70 

LINC 

72 

LINC 

74 

LINC 

76 

LINC 

78 

LINF 

80 

LINC 

82 

LINC 

8* 

LINC 

86 

LINC 

88 

LINC 

90 

LINC 

92 

LINC 

9* 

LlNC 

96 

LINC 

98 

LINF 

100 

11  nnniiiiiiuiiumniiiniii 
111111  in  1  liuizminii  11  11 
1111111111111111211111111111111111 
1111111111111111111111121111111111 
1111111111111111111211111111111111 
222221111111111111  111111111111112 
1222211111111111111111111111111112 
111 1111 11111 11 11 111 1111 1111  mini 

1111111111111221111113211111112111 
1111111112321111111232222212326211 
1 11111 1347997779955445444*22245542 
11 11*631 66AABC000S867 7665*4533 3653 
U1U136T965576A765AA578A9A76533A5 

II  11 168464336773 32 1256798 A 69b%335 

III  1  366222124331UU268885345534  T 
1111 32 32122222121111269 1632223457 

1111111111354323443346795422211466 
1  11  1115698434433359998654332466 

I  11  124765323434468879433343588 

II  111  11 13643221 3432344444222 1256 AC 
11  11 1 1143211111231233332236558887 
1  1  11152111111113653332288469887 

I  11112332111111113654532264369757 
1111113521111111113523321111389559 

II  111  1221 11  Mil  111121211 1  1 1268544  A 
111211111  1111111111111123644569 
2433121111111111  11111111447866898 
3442223111111111111142112348878898 
2222224111111111111143111226719894 
2122252111111111111262111136767884 
11233411111111111  1352124244656668 
1112231111111111111362125444444568 

2222111111111112112641112533223676 
1112111211111111112321123332122453 
11322)1211111211113221112121112263 
1117111111112221122111111121112653 
1111111112227232222121111111112266 
1111111112121121211111111111111212 
1211122111111111211111111111111111 
6211111111111111111111111111111111 
2111111111111111111111111311111111 
1111111111111111111111111111111111 
1111111111111111111111111111111111 
11111111111111  1111111111  11111111 
1111111111111111111111111111111111 
11111111111111111  1  111  11111111 
1111111111111111111111111111111111 
2111111111111  11111111111111111111 
122U1I111U1  11111111111111111111 
1233?2111111 1111111111111 11111111 1 


111111111111 

iiniiuu 

111111111111 

inumuii 

111111111121 

112111111363 
221211111332 
3211122222632 
6321135443633 
5*64479764757 
S689AAA776697 
8978985346967 
7536864236988 
533552236995 
422352116742 
332262359532 
223*46947423 
3656S6C07S866 
9*53698*68*85 
84*59**88 A3 *7 
988588CCA9775 
9AEC9AAC97657 
8AC  976899653* 
5997778887432 
7996*7756*554 
*9976758997*6 
97755556877*6 
7655655666476 
6545554565687 

8456766554689 
766878986457? 
6688*51975655 
55776779*6445 
3444665764443 
2234666643322 
2123*575*2222 
1122**5*21121 
121233311111 
111111111111 
111111112111 
111111112111 
111111111111 
111211111111 
121111111111 
111111111111 
111111111111 
111111111111 
111111111111 
111111111111 
111111  111111 


11111111111111111111111111111112 
lnimunu  111111111111111122 
11111111111111111111111111221112 
11111111111111111111111111221122 
lmmuuiuim  1111111211122 
mimmuiiiuii  111111222222 
1112111111111111111111111 2222222 
22232111111111111111111121222222 
33332221111111111111111121121222 
54343332111221111111111121112222 
6444665444*422 111111111111212222 
5666*98t8?6733222ll 11 1111 12221 11 
374**875677855332211112222121122 
653975544545232*2212345432222211 
6429622221222246322368*632222222 
7559522111132*632237975532232222 
875522211112*7421288434323322222 
853222111112732H665434455433222 
7633221 22 1 25*2 il 1 453 3*2*55432222 
563221222145332236522232*6532222 
8743212111212121112112111*542222 
976432222221111  Ull  1111113642211 
633753222211111111111111254*3222 
53*8? 53 33 32 211111112111233$ 3* 3 22 
4559^64447*743222*32111 122235322 
435887**9796632233211122*63*5322 
323*9899*87653333211112566355*21 
32258769768*9643222212364*33*321 
5*788 757769**96*432222*76*333*22 
785566679***8**44*24745852356432 
44445577689*9864323*785664445422 
33334545644434555447656445653232 
322 23 33 54 ?3 32221 1 3*53 32 125564432 
2222223322322111111221111*225543 
1111222212211111211111111 22233** 
11 12222212221112111 1111 11112332^ 
11132111211111111111121111111311 
11232112212111111111111111111121 
11111111211111111111111111111111 
111111 11111  111  ill  111  111111111  111 

i  mini  ill  mi  nil  lnimiii  m 
11111212111112111121111111111111 
11111222222112232121111111111111 
11111111111112222122211111111111 
11111111111111111111221111111111 
11111111111111111111111111111  111 
11111111111111111111111111111111 
11111111111111112221111111112211 
11111111111111111111111111111111 
i  lniiiiuuuiuuiuiuuiiiu 


21111111 
22111112 
22111111 
22111111 
33222111 
32222111 
32222111 
22222111 
22222211 
22222111 
12222211 
22322221 
23322221 
22222211 
22122221 
22221211 
21211221 
21112221 
11111222 
11111121 
11211111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
11111111 
31111111 
23111111 
13111111 
11311112 
11221122 
1113*222 
11123132 
11111222 
11112111 
u  mu 


1 

1 

1 

2 

1 

1 

2 

1 

1 

1 

1 

1 

1 

1 

1 


1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

2 

3 

2 

1 

1 

1 

2 


(a)  EACH  DIGIT  REPRESENTS  THE  BRIGHTNESS  IN  A  5  BY  5  MILE  ELEMENT  The  digit  1 
represents  brightness  of  10-19,  2  represents  20-29,  etc. 


(b)  REPRESENTATIONS  OF  THE  SAME  BRIGHTNESS  DATA  ON  A  COMPUTER-CONTROLLED 
CATHODE-RAY-TUBE  DISPLAY  USING  A  10-LEVEL  GRAY  SCALE 


FIGURE  11  REPRESENTATION  OF  BRIGHTNESS  VALUES  FOR  A  250  BY  500  MILE 
REGION  IN  THE  ATLANTIC  OFF  THE  BRAZILIAN  COAST  AT  1602  GMT, 
24  JUNE  1970  (TAPE  R-1) 
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(a)  EACH  DIGIT  REPRESENTS  THE  BRIGHTNESS  IN  A  5  BY  5  MILE  ELEMENT.  The  digit  1 
represents  brightness  of  10-19,  2  represents  20-29,  ate. 


(b)  REPRESENTATIONS  OF  THE  SAME  BRIGHTNESS  DATA  ON  A  COMPUTER-CONTROLLED 
CATHODE-RAY-TUBE  DISPLAY  USING  A  10-LEVEL  GRAY  SCALE 

FIGURE  12  REPRESENTATION  OF  BRIGHTNESS  VALUES  FOR  A  250  BY  500  MILE 
REGION  IN  THE  ATLANTIC  OFF  THE  BRAZILIAN  COAST  AT  1628  GMT, 
24  JUNE  1970  (TAPE  R-2) 
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FIGURE  13  COMPUTER  PRINTOUT  OF  THE  BRIGHTEST  300  POINTS  OF  FIGURE  11 
(TAPE  R-1) 


29 


LINE 

2 

# 

LINE 

4 

• 

LINE 

6 

* 

LINE 

8 

• 

LINE 

10 

• 

LINE 

12 

• 

LINE 

14 

• 

LINE 

16 

• 

LINE 

18 

LINE 

20 

8 

LINE 

22 

•  9969AA97 

7799A97  8  88  7 

LINE 

2* 

•  999 ABC DC  A A 8988  8 

9A  9 

9989  §99 A A  7 

LINE 

26 

•  A  AA*T 

7ABBBA7  BAA 

989  49A96  8 

LINE 

28 

•  A97 

98BBA89  900 

78  8 

LINE 

30 

• 

668 

7  986 

9  68 

799 

LINE 

32 

# 

9  8 

7 

LINE 

3* 

• 

09 

8B7  AS 

6 

LINE 

36 

•  88 

78987 

9 

ASS  98  79 

9 

LINE 

30 

7  9 

0BC6897 

8A A  989 

LINE 

40 

6ACE8AA668 A98A9A9  8 

LINE 

42 

699  9A899BC86AACA68  9*8 

LINE 

44 

7  8  898 AADE8  AA698  89 

LINE 

46 

• 

97  66I96C6 

989  87 

LINE 

41 

# 

99  8  89AA9 

8  887 

LINE 

50 

• 

8  9  87 

7  7  89B  8*8 

LINE 

52 

8  77  8 

9  79  *9688 

LINE 

54 

8  78999 

AT  8  S  9 

line 

56 

09968 

44  6  99 

line 

58 

8  799 

7  S97  9  6*69 

86 

LINE 

60 

0807 

7  77A  AAS 

7  8 

LINE 

6? 

0 

4  7  899 

7 

LINE 

64 

• 

7 

LINE 

66 

# 

0 

LINE 

«st) 

•l 

7 

line 

TO 

LINE 

72 

LINE 

T* 

UINE 

76 

LINE 

70 

LINE 

SO 

LINE 

82 

LINE 

84 

LINE 

86 

line 

84 

LINE 

90 

LINE 

92 

LINE 

94 

LINE 

96 

line 

98 

LINK 

100 

lUHtJE «  OE  CAROS  KfPT  104  OUT  OE  309  AETER  CHECKING  NEIGHBORS 


FIGURE  14  COMPUTER  PRINTOUT  OF  THE  BRIGHTEST  300  POINTS  OF  FIGURE  12 
{TAPE  R-2) 
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WESTERN  4TL4NT1C  0CE4N  OFF  THE  0RAZ1L14N  COAST, 

TAPF  R-l  LINES  1180  TO  1579  COL  5751  TO  6950  GREY  77  TO  500 

12  INITIAL  CC-5  GENERATEO  USING  4  SPHERE  FACTOR  OF  20.0000 
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aVG.  015T.  FROM  EACH  CLU5TER  CENTER  TO  THE  OTHER  CLU5TER  CENTER5 

31.7455  37,0226  35.4767  69,7765  49.3374  40.7533  60,6506  36.9460  33.1876  45.8666 
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FIGURE  15 


COMPUTER  PRINTOUT  OF  INFORMATION  ABOUT  GROUPS  FROM  THE 
ISODATA  PROGRAM  FOR  THE  DATA  SHOWN  IN  FIGURE  13 
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FIGURE  16  COMPUTER  PRINTOUT  FROM  ISODATA  FOR  FIGURE  14 
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CONVERGED  AFTER  4  ITERATIONS 


FIGURE  17  COMPUTER  PRINTOUT  OF  THE  POINTS  OF  FIGURE  13  ALONG  WITH 
BRIGHTNESS  CENTERS.  The  dots  represent  cloud  elements  and  the  C's 
represent  brightness  centers  selected  by  ISODATA.  Points  belong  to  groups 
represented  by  the  nearest  center.  (The  C's  may  overlie  data  points.) 
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CONVERGED  after  3  ITERATIONS 

FIGURE  18  CLOUD  ELEMENTS  FROM  FIGURE  14  AND  BRIGHTNESS  CENTERS 
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FIGURE  19 
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BRIGHTNESS  CENTERS  ON  TWO  CONSECUTIVE  PICTURES.  The  brightness 
centers  from  Figure  17  are  represented  by  Vs,  and  those  from  Figure  18  are 
represented  by  2's,  while  3's  represent  superposed  Vs  and  2's. 
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FIGURE  20  COMPUTER  PRINTOUT  OF  INFORMATION  FROM  THE  MOTION  PROGRAM. 

The  upper  table  shows  the  "FIT"  between  all  pairs  of  centers.  The  lower  table 
shows  matched  pairs,  motion  components  (u  and  v),  location,  etc. 
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•  I . I . I 

average  J  average  V  Nn. VECTORS 
.32  12,00 


FIGURE  21  THE  BRIGHTNESS  CENTERS  MATCHED  IN  PAIRS  BY  THE  MOTION  PROGRAM. 

The  pairs  are  denoted  by  alphabetical  letters.  Brightness  center  motions  are  from 
Vs  to  2's. 
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FIGURE  22  A  CRT  DISPLAY  OF  BRIGHTNESS  DATA  FOR  A  PORTION  OF  THE  EASTERN 
ATLANTIC  (TAPE  R-1) 
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FIGURE  23  A  CRT  DISPLAY  OF  BRIGHTNESS  DATA  FOR  A  PORTION  OF  THE  EASTERN 
ATLANTIC  (TAPE  R-2) 
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FIGURE  24  COMPUTER  PRINTOUT  OF  THE  300  BRIGHTEST  ELEMENTS  FROM  FIGURE 
22  (TAPE  R-1 )  ALONG  WHICH  BRIGHTNESS  CENTERS  FOUND  BY  ISODATA 
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Co\>*  -  .nr-  .  ,  n  , 

FIGURE  25  COMPUTER  PRINTOUT  OF  THE  300  BRIGHTEST  ELEMENTS  FROM  FIGURE 
23  (TAPE  R-2)  ALONG  WITH  BRIGHTNESS  CENTERS  FOUND  BY  ISODATA 
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FIGURE  26  THE  BRIGHTNESS  CENTERS  MATCHED  IN  PAIRS  BY  THE  MOTION  PROGRAM. 
Cloud  motions  are  from  Vs  to  2's. 
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(a)  DIGITAL  PRINTOUT 


(b)  CRT  DISPLAY  OF  THE  BRIGHTNESS  DATA 


FIGURE  27  REPRESENTATION  OF  BRIGHTNESS  VALUES  FOR  A  250  BY  500  MILE 
PORTION  OF  THE  ITCZ  FROM  TAPE  R-1 
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(a)  DIGITAL  PRINTOUT 


(b)  CRT  DISPLAY  OF  THE  BRIGHTNESS  DATA 

FIGURE  28  REPRESENTATION  OF  BRIGHTNESS  VALUES  FOR  A  250  BY  500  MILE 
PORTION  OF  THE  ITCZ  FROM  TAPE  R-2 
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FIGURE  29  COMPUTER  PRINTOUT  OF  THE  300  BRIGHTEST  ELEMENTS  FROM  FIGURE 

27  (TAPE  R-1)  ALONG  WITH  BRIGHTNESS  CENTERS  SELECTED  BY  ISODATA 
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FIGURE  30  COMPUTER  PRINTOUT  OF  THE  300  BRIGHTEST  ELEMENTS  FROM  FIGURE 

28  (TAPE  R-2)  ALONG  WITH  BRIGHTNESS  CENTERS  SELECTED  BY  ISODATA 
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FIGURE  31  THE  BRIGHTNESS  CENTERS  MATCHED  IN  PAIRS  BY  THE  MOTION  PROGRAM. 
Cloud  motions  are  from  1's  to  2's. 
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FIGURE  32  COMPUTER  PRINTOUT  OF  300  ELEMENTS  FROM  FIGURE  27  (TAPE  R-1) 
IN  THE  INTERMEDIATE  BRIGHTNESS  RANGE  61-75  ALONG  WITH 
BRIGHTNESS  CENTERS  FOUND  BY  ISODATA 
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FIGURE  33  COMPUTER  PRINTOUT  OF  ELEMENTS  IN  THE  BRIGHTNESS  RANGE  61-75 
FROM  FIGURE  28  (TAPE  R-2)  ALONG  WITH  BRIGHTNESS  CENTERS  FOUND 
BY  I  SO  DATA 
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THE  BRIGHTNESS  CENTERS  MATCHED  IN  PAIRS  BY  THE  MOTION  PROGRAM 
Cloud  motions  are  from  Vs  to  2's. 
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VI  PICTURE  REGISTRATION,  RECTIFICATION,  AND  GRIDDING 

The  problems  of  registering,  rectifying,  and  gridding  ATS  digital 
pictures  are  of  significant  importance,  as  mentioned  in  Section  II.  Here 
registration  means  associating  equivalent  locations  (in  tape  coordinates) 
on  two  pictures.  Rectification  means  adjusting  the  tape  coordinates 
(with  respect  to  an  ideal  picture)  to  correct  for  rotation,  stretching, 
and  ideally,  internal  deformation.  Gridding  is  the  transformation  from 
tape  coordinates  to  earth  (geographical)  coordinates.  The  computer  pro¬ 
grams  developed  in  this  study  to  perform  these  operations  require  that 
several  landmarks  be  found  by  computer  on  each  picture  being  treated. 

(The  program  MATCH,  described  earlier,  does  this. )  Using  the  landmark 
locations  in  tape  coordinates  (X,Y),  adjustments  are  made  to  map  one 
picture  onto  another  using  translation,  rotation,  and  stretching. 

(Further  corrections  to  account  for  internal  distortions  of  pictures, 
which  are  of  relatively  small  magnitude,  appear  not  to  be  needed  at  this 
time. )  Cloud  motions  are  determined  in  tape  coordinates  using  the 
registered  pictures.  From  the  known  latitude  and  longitude  of  the  land¬ 
marks,  their  (X,Y)  coordinates  on  an  ideal  (or  nominal)  picture  can  be 
computed.  (The  characteristics  of  an  ideal  picture  are  calculated  as¬ 
suming  that  the  satellite  remains  fixed  over  a  point  on  the  equator  at 
a  certain  distance  from  the  earth,  with  its  spin  axis  parallel  to  the 
earth’s  axis.)  By  comparing  the  actual  coordinates  of  the  landmarks  of 
a  particular  picture  to  the  corresponding  ideal  coordinates,  the  picture 
is  mapped  on  the  ideal  picture,  and  this  facilitates  a  transformation 
from  picture  coordinates  to  earth  coordinates.  Digital  techniques  for 
performing  these  operations  comprise  the  program  CORRECT,  which  is 
described  below. 
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The  procedure  takes  advantage  of  certain  characteristics  of  ATS 
data.  A  primary  characteristic  is  the  great  similarity  of  pictures  made 
within  a  few  hours  (barring  equipment  malfunctions).  This  similarity 
allows  the  pictures  to  be  used  in  movie  loops  (e.g.,  "Fujita  et  al.,  1968; 
Hubert  and  Whitney,  1971)  or  to  be  viewed  on  a  TV  display  console  (Evans 
and  Serebreny,  1969).  Greatest  accuracy  in  visual  registration  is 
achieved  by  treating  magnified  sections  of  pictures  in  the  vicinity  of 
recognizable  landmarks. 

Corrections  are  needed  because  of  imperfections  in  the  satellite’s 
orbit  and  attitude  (User's  Guide,  1969).  The  orbital  factors  vary  over 
a  period  of  24  hours  (approximately),  and  therefore  the  changes  within 
an  hour  or  so  may  be  represented  as  quasi-linear .  One  orbital  imperfec¬ 
tion  is  the  small  inclination  of  the  satellite’s  orbital  plane  with  re¬ 
spect  to  the  earth's  equatorial  plane.  Due  to  this  inclination,  at 
certain  hours  the  satellite  subpoint  will  be  north  of  the  equator,  and 
12  hours  later,  it  will  be  south  of  the  equator.  The  latitude  of  the 
extreme  excursions  equals  the  orbital  inclination.  Another  orbital  im¬ 
perfection  is  the  eccentricity  (noncircularity)  or  the  orbit,  which 
causes  an  east-west  oscillation  of  the  satellite  subpoint,  and  minor 
changes  in  the  size  of  the  earth’s  photographic  image.  Together,  these 
two  orbital  factors  cause  the  subpoint  to  execute  a  small  figure  eight 
pattern  every  24  hours  crossing  the  equator  at  the  nominal  (or  ideal) 
subpoint.  The  satellite  subpoint  may  also  undergo  a  gradual  drift  along 
the  equator  due  to  orbital  precession. 

The  ATS  satellites  spin  at  approximately  100  rpm  around  an  axis 
oriented  approximately  parallel  to  the  earth’s  north-south  axis.  Even 
a  slight  lack  of  parallelism  causes  the  earth’s  image  to  move  signifi¬ 
cantly  in  the  picture  frame  from  one  picture  to  another.  This  can  be 
seen  as  follows.  There  are  two  points  in  the  orbital  path  (12  hours 
apart)  where  the  satellite’s  spin  axis  and  the  earth's  axis  lie  in  a 
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plane.  At  one  of  these  points  the  northern  portion  of  the  earth* s 
visible  disk  may  touch  or  extend  beyond  the  top  of  the  picture  frame; 
while  at  the  opposite  orbital  point  the  disk  lies  toward  the  bottom  of 
the  frame.  Thus  in  picture  coordinates,  the  earth's  disk  appears  to 
move  up  and  down  by  rather  large  amounts.  Corrections  for  this  effect 
can  be  made  rather  easily  by  disk  matching  using  chords,  as  described 
earlier.  At  two  orbital  points  intermediate  between  the  pair  mentioned 
above,  the  satellite’s  spin  axis  departs  by  a  maximum  amount  from  a 
plane  through  the  earth’s  axis  and  the  satellite.  At  one  of  these  latter 
points,  the  earth's  image  in  the  picture  frame  is  rotated  clockwise  from 
its  nominal  position,  and  at  the  opposite  orbital  point  it  is  rotated 
counterclockwise. 

The  basic  concept  we  have  been  following  for  registering  one  picture 
of  a  daily  sequence  to  another  depends  upon  the  use  of  several  well- 
defined  landmarks  distributed  around  the  picture  but  not  lying  too  close 
to  the  edge  of  the  image.  On  the  image  plane  (nominally  through  the 
earth’s  center  and  perpendicular  to  a  line  joining  the  center  and  the 
satellite),  the  (X,Y)  coordinates  of  the  landmarks  are  found  on  two 
pictures.  The  MATCH  program  for  doing  this  was  described  earlier. 

Because  of  the  nature  of  the  orbital  and  attitude  variations  discussed 


above,  the  landmarks 

of 

one 

picture  (or 

image)  can  be  made  to  coincide 

quite  accurately  with 

those 

on  a  second 

image  by  use  of 

translation. 

rotation,  stretching 

in 

the 

x  direction, 

and  stretching 

in  the  y  direc- 

tion.  However,  further  corrections  to  images  to  account  for  internal 
distortions  (due  primarily  to  the  figure  eight  motion  of  the  subpoint) 
can  be  made  by  reference  to  the  periodic  nature  of  the  orbital  factors. 
In  the  pictures  we  have  treated,  such  distortions  are  small.  We  have 
not  yet  begun  to  write  computer  programs  to  make  such  corrections. 

Another  basic  aspect  of  the  problem  is  the  transformation  from  tape 
coordinates  to  latitude  and  longitude,  i.e.,  gridding.  As  mentioned 
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earlier,  an  ideal  picture  would  be  obtained  if  the  satellite  were  fixed 
over  the  equator  at  a  certain  longitude,  at  a  known  distance  from  the 
earth,  with  its  spin  axis  parallel  to  the  earth's  axis.  Also,  the  ideal 
photographic  image  of  the  earth’s  disk  would  be  circular,  with  a  known 
radius  and  a  fixed  center.  Then  using  plane  and  spherical  trigonometry, 
one  can  transform  (X,Y)  tape  coordinates  to  (cp,  X)  earth  coordinates,  or 
the  reverse.  These  transformations  are  performed  by  the  subroutines 
XLAT  and  LATX  respectively,  which  use  equations  similar  to  those  em¬ 
ployed  by  L.  D.  Herman  of  the  National  Environmental  Satellite  Center. 

In  using  these  techniques  one  can  proceed  as  follows.  The  first 
step  is  to  transform  the  tape  coordinates  of  the  landmarks  so  that  the 
X  and  Y  scales  are  equivalent,  and  the  distances  are  measured  from  the 
nominal  picture  center  at  X  =  4000,  Y  =  1200.  That  is,  X/  =  (X-4000)/ 
XSCALE  where  XSCALE  =  3.0,  and  Y7  =  Y-1200.  (The  factor  XSCALE  makes 
the  column  elements  commensurate  in  length  with  row  elements. )  For  con¬ 
venience,  the  primes  are  omitted  in  the  subsequent  discussion.  For 
several  landmark  templates  to  be  used  with  a  series  of  pictures,  the 
latitude  (co)  and  longitude  (X)  of  the  centers  (or  corners)  of  each  tem¬ 
plate  are  determined  as  closely  as  possible  by  reference  to  an  atlas. 

At  present,  landmarks  are  selected  by  inspection  of  pictures.  Selecting 
them  and  determining  the  geographic  coordinates  of  the  templates  are  the 
only  steps  of  the  sequence  that  require  human  judgment.  This  operation 
is  done  using  an  atlas  version  of  a  landmark,  which  naturally  has  abso¬ 
lute  or  ideal  gridding  information  on  it.  The  geographic  values  of  one 
point  on  the  atlas  are  associated  with  the  corresponding  point  on  the 
template.  The  judgment  of  correspondence  is  the  human  operation  re¬ 
quired.  Since  an  accurate  atlas  with  a  suitable  scale  may  be  used,  the 
crucial  part  of  this  operation  is  in  recognizing  the  corresponding  fea¬ 
tures  on  the  template.  Using  standard  atlases,  we  believe  that  this  can 
be  done  reliably  to  about  the  2.5  mile  resolution  of  the  nearest  single 
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element  of  the  satellite  image.  The  error  enters  into  the  location  of 
the  cloud  motion  vectors,  but  since  it  is  the  same  on  pictures  of  a  se¬ 
quence,  it  does  not  affect  the  motion  vectors  themselves. 

Using  the  subroutine  LATX,  the  nominal  locations  (X  ,Y  )  in  tape 

n  n 

coordinates  are  computed  for  each  landmark  from  its  cp  and  X.  The  sub¬ 
routine  REGISTER  is  then  used  to  determine  the  corrections  for  transla¬ 
tion,  rotation,  and  stretching,  to  match  the  landmarks  (X^,Y^)  ° f  a  given 
picture  onto  the  ideal  picture.  The  translation  corrections  in  X  and  Y 
are  added  to  the  nominal  center  to  give  the  center  of  picture  1,  which 
is  needed  in  subsequent  computations. 

The  next  step  is  to  register  a  second  picture  to  the  first  (non¬ 
ideal)  picture  by  comparing  the  landmarks,  again  using  REGISTER.  The 
translation  corrections  are  applied  to  picture  2  to  find  areas  that  cor¬ 
respond  to  segments  of  picture  1  before  applying  ISODATA  and  MOTION  to 
the  pair  of  pictures.  This  gives  a  matching  of  areas  that  is  sufficiently 
accurate  to  ensure  that  ISODATA  and  MOTION  operate  with  intended  con¬ 
tinuity.  The  cloud  motions  from  these  programs  are  in  the  coordinates 
of  picture  1,  and  are  then  corrected  to  account  for  the  rotation  and 
stretching  needed  to  register  picture  2  on  picture  1.  In  the  next  step, 
the  cloud  motions  and  their  locations  in  picture  1  coordinates  are  trans¬ 
formed  to  ideal  tape  coordinates  (X  ,Y  )  using  the  corrections  determined 

n  n 

earlier  to  transform  picture  1  to  the  nominal  picture.  Finally,  using 
the  subroutine  XLAT,  the  transformation  of  cloud  motions  to  earth 
coordinates  is  made. 

The  differences  between  one  picture  and  another  are  illustrated  in 
Figure  35(a),  which  depicts  four  landmarks  at  their  nominal  positions. 

Due  to  the  factors  mentioned  earlier,  the  same  landmarks  appear  at  dif¬ 
ferent  positions  in  the  image  frame  of  a  second  (non-ideal)  picture,  and 
are  depicted  by  solid  squares  in  Figure  35(b).  In  greatly  exaggerated 
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X 


(b)  LANDMARK  LOCATIONS  (SOLID  SQUARES)  AFTER  TRANSLATION,  ROTATION,  X-STRETCHING 
AND  Y-STRETCHING 

FIGURE  35  HYPOTHETICAL  LANDMARKS  (SQUARES)  ON  A  PICTURE 


56 


form.  Figure  35(b)  shows  effects  of  translation  as  solid  lines,  the  same 
for  each  of  the  landmarks.  The  effect  of  rotation,  indicated  by  dots, 
is  proportional  to  the  length  of  the  radius  of  each  landmark  from  the 
center  of  the  first  image,  and  is  perpendicular  to  the  radius.  The  ro¬ 
tation  shown  is  counterclockwise.  The  effect  of  X-stretching  is  pro¬ 
portional  to  the  distance  of  the  landmark  from  the  north-south  axis  of 
Figure  35(a).  This  effect  is  illustrated  for  expansion  by  the  xfs  in 
Figure  35(b).  The  effect  of  Y-stretching  is  proportional  to  the  distance 
of  the  landmark  from  the  east-west  axis  of  Figure  35(a).  This  effect  is 
indicated  by  the  dashed  line  segments  in  Figure  35(b).  Due  to  the  orbi¬ 
tal  and  attitude  features  mentioned  earlier,  X-stretching  and  Y-stretching 
may  be  of  either  the  same  or  opposite  sign.  The  final  positions  of  the 
landmarks  on  the  second  picture  are  denoted  by  solid  squares,  as  men¬ 
tioned  above. 


Knowing  the  (X,Y)  locations  of  the  landmarks  in  picture  1  (denoted 
by  open  squares)  and  in  picture  2  (denoted  by  solid  squares),  we  must 
determine  the  translation,  rotation,  X-stretching,  and  Y-stretching,  re¬ 
quired  to  map  picture  2  onto  picture  1.  The  iterative  subroutine 
REGISTER  operates  as  follows. 


The  X  correction  for  translation,  XCT,  and  the  Y  correction,  YCT, 
are  computed  as 


XCT 


YCT 


(X  -X  ) 
1  2 


(VV 


Here  the  subscript  1  pertains  to  picture  1,  2  pertains  to  picture  2,  and 
n  =  4  in  Figure  35.  Improved  values  of  the  landmark  locations  on 
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Y  +  YCT . 
2 


picture  2  corrected  for  translation  are  =  X  -I-  XCT,  Y ^ ^  = 

2  2  ’  2 

Superscripts  denote  stages  in  the  computation. 

The  corrections  for  the  rotation  are  computed  as 


XCR  =  -  )  -[X 

n  /  ^  L  1 

i 

n 

vcR  =  ^X  [vi 


]/Y 


(1) 

2 


(1) 

If  Y^  is  rather  small  for  a  certain  point,  to  avoid  the  inaccuracy  of 
dividing  by  a  number  close  to  zero  the  point  is  excluded  from  the  compu¬ 
tations  of  XCR,  and  a  similar  treatment  of  small  denominators  is  made  in 
computing  other  corrections.  For  solid  rotation  the  two  corrections  XCR 
and  YCR  must  be  the  same,  so  that  the  final  rotation  correction  is 

CR  =  1/2  (XCR  +  YCR).  Improved  values  of  landmark  locations  are 

(2)  (1)  (1)  (2)  (1)  (1) 

X  =  X  -  CR  •  Y  and  Y  =  Y^  +  CR  •  X^ 

2  2  2  2  2  2 

The  corrections  for  X-stretching  and  Y-stretching  are  computed  as 


xcs  =  112  txi 


]/x 


(2) 

2 


YCS 


As  mentioned  earlier,  XCS  and  YCS  are  generally  not  equal.  Improved 
values  of  the  locations  of  landmarks  on  picture  2  (with  respect  to 


(3) 

(2) 

+ 

xcs  • 

(2) 

X 

=  X 

X„ 

2 

2 

2 
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(2) 
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Y 
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+ 
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picture  1)  are 


The  computational  cycle  is  repeated  several  times  giving  improved 
values  of  the  various  corrections.  It  is  terminated  when  the  estimates 
cease  improving,  or  when  the  number  of  iterations  reaches  a  preset 
limit.  In  numerous  test  cases  using  data  formulated  to  evaluate  the 
technique,  10  iterations  or  less  have  given  acceptable  convergence. 

The  total  corrections  to  register  any  point  of  picture  2  onto 
picture  1  use  translation,  rotation,  and  stretching,  and  may  be  computed 

as 

DX  =  XCT  -  CR  •  (Y  +  YCT)  +  XCS  •  (X  +  XCT) 

2  2 

DY  =  YCT  +  CR  *  (X  +  XCT)  +  YCS  •  (Y  +  YCT) 

2  2 

The  corrected  values  of  picture  2,  registered  to  picture  1,  are 

(c) 

X  '  =  X  +  DX 
2  2 

(c) 

Y  =  Y  +  DY 
2  2 

This  iterative  process  is  intended  to  perform  operations  like  those 
a  human  does  in  visually  matching  landmarks  of  one  transparent  cloud 
photograph  to  another;  for  example,  using  a  light  table  or  TV  display 
device.  However,  we  believe  that  the  digital  method  is  faster  and  more 
exact.  A  formal  mathematical  procedure  to  achieve  the  same  results  as 
this  iterative  technique  could  probably  be  formulated,  perhaps  using 
least-squares  fitting  methods;  however,  the  results  obtained  iteratively 
appear  to  be  satisfactory  for  present  purposes,  and  we  have  not  pursued 
this  matter  further. 
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VII  PRELIMINARY  ESTIMATE  OF  TIME  AND  COSTS 


As  mentioned  earlier,  the  present  computer  programs  require  con¬ 
tinued  testing  and  improvement,  and  considerable  changes  are  anticipated 
to  improve  their  logic  and  their  generality  of  application.  Certain 
additional  steps  may  be  needed,  and  some  present  ones  may  be  dropped. 

In  spite  of  these  uncertainties,  we  have  made  an  estimate  of  the  costs 
as  presently  envisioned. 

A  basic  assumption  in  computing  the  costs  of  our  system  is  that 
the  data  will  be  processed  sequentially  as  50  by  100  element  arrays 
with  each  element  corresponding  to  the  brightness  of  a  5  by  5  mile  area 
(approximately).  In  the  250  by  500  mile  region  covered  by  an  array, 
about  10  cloud  motion  vectors  will  be  found  in  a  typical  case.  About 
200  applications  of  the  programs  will  be  needed  to  cover  the  useful 
area  of  the  earth's  disk.  Also,  it  is  assumed  that  10  landmarks  will 
be  matched  on  each  pair  of  tapes.  The  amount  of  computer  core  storage 
needed  will  be  100  K  octal  (32,000)  words  or  less.  Approximately  four 
hours  of  central  processing  time  on  a  CDC  6400  computer  would  be  required 
to  process  three  pairs  of  tapes  from  a  daily  sequence.  (It  is  possible 
that  only  two  pairs  would  be  needed  in  order  to  provide  sufficient  checks 
on  consistency  of  motions.)  This  represents  a  cost  per  cloud  motion 
vector  equivalent  to  2  to  3  seconds  of  CDC-6400  computer  time.  In  an 
operational  system  such  costs  might  amount  to  roughly  30  cents  per 
vector.  (At  SRI,  using  an  accounting  algorithm  for  research  programs 
the  cost  is  approximately  2  to  3  times  as  large.)  Major  reductions  in 
costs  can  be  achieved  by:  improving  the  computer  programs  and  hardware 
utilization;  using  a  larger  and  faster  computer;  averaging  the  data  to 
give  larger  elements;  and,  at  SRI,  using  nighttime  computing  at  a 
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special  accounting 
(or  less)  than  the 
by  human  operators 


rate.  These  computer  costs  are  only  about  one-half 
estimated  costs  of  present  cloud  motion  determination 
(W.  E.  Evans,  private  communication,  1972). 
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VIII  SUMMARY 


The  previous  sections  of  this  report  describe  a  family  of  objective 

methods  being  developed  to  provide  automatic  determination  of  cloud 

motions  from  sequences  of  satellite  pictures.  A  critical  part  of  the 

concept  is  that  of  using  the  data  in  original  coordinates,  i.e.,  tape 

records  (picture  lines),  and  words  within  records.  Transformations  to 

earth  coordinates  are  made  last.  This  gives  a  large  saving  in  computer 

3 

processing  time,  since  the  transformations  need  be  made  only  to  the  10 

4  7  8 

to  10  cloud  motion  vectors  obtained,  and  not  to  the  10  to  10  picture 

elements  of  an  image.  Also,  serious  inaccuracies  in  cloud  motions  that 
may  be  introduced  by  imprecise  transformation  of  entire  images  are 
avoided.  Landmark  registration  is  done  objectively,  and  the  results 
are  accurate  to  one  picture  element  (i.e.,  approximately  2.5  miles). 

Higher  accuracy  can  probably  be  obtained  by  averaging  results  from 
several  nearby  landmarks,  and  by  including  orbital  and  attitude  infor¬ 
mation.  In  selected  cases  studied  so  far,  the  ISODATA  and  MOTION  pro¬ 
grams  give  results  that  appear  very  reasonable  for  single  cloud  layers 
having  a  rather  uniform  motion.  However,  the  present  methods  do  not 
cope  adequately  with  complex  motions  of  phenomena  such  as  the  ITCZ.  We 
have  formulated  some  additional  concepts  to  handle  such  cases,  and  will 
test  them  in  further  work.  One  concept  is  to  identify  local  centers 
that  contrast  with  the  nearby  brightness,  which  may  be  relatively  low 
or  high.  One  way  to  find  them  would  be  to  average  the  picture  with  a 
smoothing  operator,  and  then  take  deviations  from  the  average.  Another 
possible  method  would  use  a  grouping  logic  analogous  to  that  of  Duda 
and  Blackmer  (1972)  for  finding  local  centers.  Finally,  we  have  developed 
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a  major  part  of  a  procedure  for  accurate  transformation  of  cloud  motions 
in  tape  coordinates  to  earth  coordinates. 

The  accuracy  of  the  cloud  motion  measurements  depends  on  the 
accuracy  achieved  in  the  separate  steps,  and  we  have  not  yet  determined 
the  limitations  on  them.  However,  the  results  so  far  are  believed  to 
be  acceptable  according  to  usual  meteorological  standards. 

The  results  which  are  accumulating  give  us  confidence  that  objective 
determination  of  cloud  motions  for  a  wide  variety  of  clouds  in  near  real 
time  will  be  feasible  within  approximately  a  year  from  the  time  of 
writing.  Earlier  in  Section  VII,  a  preliminary  estimate  of  computer 
facilities  needed  and  the  approximate  costs  of  cloud  motion  determination 
using  these  methods  were  given. 
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IX  FURTHER  RESEARCH 


The  work  reported  herein  is  intended  to  lead  toward  a  procedure  to 
be  used  operationally  by  the  Fleet  Numerical  Weather  Central,  and  also 
has  application  to  the  Global  Atmospheric  Research  Program.  A  continua¬ 
tion  of  the  work  for  possible  use  in  GARP  has  been  funded  by  the  GARP 
Project  office,  Goddard  Space  Flight  Center,  NASA. 

Further  testing,  improvement,  and  documentation  of  all  of  the 
computer  programs  is  required.  One  of  the  principal  tests  of  the  ob¬ 
jective  procedures  will  be  to  compare  them  with  visual  operations  based 
on  the  same  data.  It  is  necessary  to  determine  the  similarities  and 
differences  between  computer  results  and  visual  tracking,  especially 
for  complex  cloud  masses.  Such  comparisons  may  lead  to  changes  and 
improvements  in  the  ISODATA  and  MOTION  programs.  The  SRI  electronic 
cloud  console  (Serebreny  et  al . ,  1970)  will  be  used  to  perform  these 
visual  operations. 

At  present,  information  about  the  heights  of  clouds  is  lacking, 
and  this  greatly  hampers  cloud  tracking  by  either  computer  or  visual 
methods.  This  gap  will  be  closed  to  a  large  extent  by  the  SMS  satel¬ 
lites  which  will  obtain  infrared  measurements  at  approximately  11  |i. 

Our  methods  are  intended  to  include  the  IR  data  (when  they  become  avail¬ 
able)  as  a  simple  addition  to  the  variables  used  by  ISODATA  and  MOTION. 
The  manner  in  which  IR  data  are  used  in  determining  cloud  motions  and 
assigning  altitudes  to  them,  and  the  additional  costs  of  doing  so,  will 
be  important  in  determining  both  the  operational  and  research  value  of 
cloud  motions. 
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An  investigation  is  needed  of  the  internal  distortion  in  pictures 
(neglected  so  far)  produced  by  certain  varying  orbital  parameters, 
and  of  practical  methods  for  correcting  them.  Probably  such  methods 
can  be  incorporated  into  the  present  program  CORRECT. 

Another  subject  that  requires  study  is  the  objective  analysis  of 
cloud  motions  in  combination  with  standard  data  and  other  satellite 
observations,  for  example,  temperature  profiles.  Very  probably  the 
information  found  by  ISODATA  on  the  location,  size,  and  changes  in 
cloud  groups  could  be  related  objectively  to  the  fields  of  vorticity, 
divergence,  and  vertical  motion. 

It  is  worth  noting  that  the  methods  being  developed  may  have 
applications  in  tracking  mixing  ratio  patterns  on  isentropic  surfaces. 

As  pointed  out  in  a  recent  note  (Endlich,  Mancuso,  and  Nagle,  1972), 
observations  of  temperature  and  humidity  profiles  from  geosynchronous 
satellites  such  as  ATS-F  may  make  such  isentropic  analyses  possible 
at  intervals  of  approximately  an  hour.  If  so,  tracking  humidity 
patterns  to  determine  air  motions  in  cloud-free  regions  may  become  feasi¬ 
ble  using  automatic  techniques  such  as  those  described  in  this  report. 
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